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1.  Introduction 


This  semi-annual  progress  report  contains  a  summary  of  work  accomplished  on  O.  N.  R. 
Contract  N00014-86-K-0370,  High  Resolution  Radar  Imaging,  during  the  period  from  1 

'  .December  1987  to  31  May  1988. 

£ 

The  goal  of  this  project  is  to  formulate  and  investigate  new  approaches  for  forming 
images  of  radar  targets  from  spotlight-mode,  deiay-doppler  measurements.  These  measurements 
could  be  acquired  with  a  high-resolution  radar-imaging  system  operating  with  an  ootical-  or 
radio-frequency  carrier.  Two  approaches  are  under  study.  The  first  is  motivated  by  an 
image-reconstruction  method  used  in  radionuclide  imaging  called  the  confidence-weighted 
algorithm;  here,  we  refer  to  this  approach  as  the  chirp-rate  modulation  approach.  The  second 
approach  is  based  on  more  fundamental  principles  which  starts  with  a  mathematical  model  that 
accurately  describes  tb»»  physics  of  zn  imaging  radar-system  and  then  uses  statistical-estimation 
theory  with  this  model  to  derive  methods  for^  producing  target  images;  we  refer  to  this  as  the 
estimation-iheory  approach. C s'Z.  j~ 

Fig’s.  1  to  4  summarize  a  broad  context  in  which  forming  radar  images  is  important  and 
the  way  in  which  the  methods  we  are  developing  may  be  useful  in  this  context.  Fig.  1  depicts  a 


Figure  1.  Radar  Imaging  System 

A  radar  transmitter/receiver  Hluml  nates  the  target  with  a  series  of 
pulses  and  observes  echo-data  containing  delay-doppier  information. 
These  data  are  processed  to  form  an  image  of  the  target. 
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radar  imaging  system.  Shown  is  a  single  target,  but  multi-target  and  clutter  environments  can 
be  accommodated  as  well.  Images  are  conventionally  formed  by  processing  data  acqui-ed  with  a 
series  of  target  illuminations  using  chirped-sinusoidal  or  stepped-frequency  waveforms.  The 
usual  two-dimensional  Fourier  transfoim  processing,  described  by  Wehner  [1],  is  based  on  a 
deterministic  model  in  which  there  is  no  randomness  in  tre  target’s  reflectivity  and  no  noise  in 
the  radar  data,  an  idealization  which  is  often  not  met  in  practice.  Another  form  of  processing, 
described  by  Mensa  [2],  is  based  on  tomographic  principles  and  is  also  based  on  a  deterministic 
model  for  the  problem.  The  chirp-rate  modulation  approach  which  we  are  developing  is  based 
on  tomographic  principles;  it  extends  the  approach  described  by  Mensa  through  the  use  of  a 
variable  chirp  rate,  as  first  described  by  Bemfeld  [3]  and  Feig  and  Grunbaum  [4],  so  that  only- 
small  angular  rotations  of  the  target  are  necessary  for  forming  the  image.  Our  tomographic 
method  is  based  upon  developments  in  radionuclide  imaging  and  differs  from  that  of  Bemfeld, 
Feig  and  Grunbaum  in  that  we  can  accommodate  practical  ambiguity  functions  that  do  not  yield 
the  ideal  line  integrals  required  with  the  usual  tomographic  approaches  they  employ.  The  more 
fundamental  estimation-theory  approach  which  we  are  developing  uses  a  target  model  that 
accounts  for  diffuse,  random  reflectivity  and  for  noise.  The  image  formation  process  is  derived 
mathematically  using  statistical-estimation  theory.  The  new  processing  we  obtain  is  more 
complex  and  'computationally  demanding  than  either  the  Fourier- transform  or  tomographic 
approaches,  bat  improved  images  can  result  because  it  more  accurately  accommodates  the 
physics  of  radar  imaging  problem.  At  the  present  stage  of  our  investigations,  we  are  not  overiy 
concerned  about  the  computational  load  of  the  approach  because  the  equations  to  be  evaluated 
are  qtiite  amenable  to  evaluation  on  massively  parallel  computing  arcuitectures. 

We  are  beginning  to  evaluate  the  performance  of  the  estimation-theory  approach  in 
comparison  to  conventional  Fourier  transform  processing.  Only  an  extremely  preliminary  result 
is  available  now,  but  we  include  it  to  indicate  what  we  hope  the  gains  with  our  method  may  be 
as  we  complete  a  more  complex  evaluation.  Shown  in  Fig.  2  are  the  average  results  obtained 
from  3000  realizations  with  a  computer  simulation  in  which  a  single  point-target  of  unit 
scattering  strength  (Le_,  random  reflectivity  with  power  (A  =  1)  is  illuminated  with  a  sinusoidal 
pulse. 
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Shown  are  ihe  output  signal-to-noise  ratio  and  bias  for  estimating  the 
scattering  function  of  a  point  target  with  a  periodogram  and  with  the 
estimation-theory  method. 


Shown  are  the  bias,  defined  by 


BIAS  =  E[d2]-cr2, 

asd  output  signal-to-noise  ratio,  defined  by. 


sNR„s  =  t~=, 
V  MSE 


where  MSE  is  the  mean-square  error  defined  by 

MSE=*E[(<y2}2]-E2[ff2]- 
The  input  signal-ro~  noise  ratio  is  defined  by 


sneib~  — 

iV  rt  iV  0 


is 
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where  N0  is  the  power  density  of  additive  receiver  noise.  The  scattering  strength  of  the  point 
target  was  estimated  using  a  Fourier  transfomi  method  (periodogram)  and  our  estimation-theory 
method.  For  input  signaJ-to-noise  ratios  above  about  5  dB,  the  periodogram  estimate  is  strongly 
biased  and  has  a  low  output  sign2?-to- noise  ratio.  In  this  <ame  regime,  the  estimation-theory 
method  yields  an  unbiased  estimate  with  about  a  15  dB  greater  output  signal-to-noise  ratio. 
While  this  is  an  extremely  elementary  example,  it  does  give  us  some  optimism  that  the  new 
approach  will  result  in  improved  images  compared  to  the  FGurier  transform  approach  when 
applied  in  more  realistic  situations. 


Shown  in  Fig.  3  is  a  target  identification  system  that  uses  radar  images  to  aid  in  the 


Figure  3.  A  Target  Identification  System 


Shawn  is  a  system  in  which  targets  are  identified  on  the  basis  of 
features  extracted  from  radar  images  of  the  target,  target  templets,  and 
other  collateral  information. 

identification  process.  Such  a  system  commonly  starts  with  an  image  formed  by  the 
Fourier-transform  method.  Features  such  as  edges,  regions  of  similar  texture,  and  shapes  are 
extracted.  These  are  then  used  with  a  catalog  of  possible  targets  and  other  available 
information,  such  as  target-track  data,  surveillance  data,  and  target  environment,  to  identify  the 
target  type.  Since  the  identification  process  will  be  sided  by  having  improved  target  images 
from  which  to  extract  features,  we  expect  that  more  reliable  identification  will  result  when 
images  produced  with  our  estimation-theory  method  are  used.  Note  that  in  this  system,  two 
separate  and  independent  steps  are  involved,  that  of  image  formation  followed  by  that  of 
feature  extraction  for  target  identification.  One  may  expect  that  combining  these  two  steps  in  a 
unified  manner  should  result  in  further  improvements  in  identification. 
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Shown  in  Fig.  4  is  a  potentially  improved  target  identification  system  in  which  images  are 


figure  4.  A  Unified  Target  Imaging  and  Identification  System 

Shown  is  a  system  in  which  targets  are  imaged  and  identified  in  a 
coordinated  manner  in  an  extended  estimation-theory  method  in  which 
rale-  and  statistic-based  constraints  are  recognized. 

formed  and  features  extracted  in  a  combined,  unified  manner.  This  is  accomplish***!  by 
incorporating  constraints  during  the  image  formation  and  extracwm  process.  Ccnctrahtts  may 
be  rale-based,  such  as  to  enforce  curvature  rates  cn  edges  and  closure  of  boundaries,  or 
statistic-based,  such  as  roughness  of  texture  and  prior  statistical  knowledge  of  the  target.  The 
estimation-theory  approa-h  we  are  developing  is  ideally  suited  for  incorporating  rale  and 
statistic  based  constraints  in  a  single,  coordinated  process  that  should  result  in  improved  target 
identification. 

At  the  present  ume,  research  under  this  contract  is  focused  on  two  methods  to  improve 
target  images.  Such  improvements  would  be  useful  in  the  broad  context  of  target  identification, 
particularly  for  the  separated  identification  system  of  Fig.  3.  In  oar  laboratory,  a  strong 
research  effort  on  image  estimation  subject  to  rule-  and  statistic-based  constraints  has  been 
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initiated  [5],  with  a  view  towards  implementations  on  highly  parallel  computer  architectures. 
We  envision  that  these  developments  will  be  important  for  a  unified  target  imaging  and 
identification  system  in  the  form  of  Fig.  4. 

2.  Summary  of  Work  Accomplished 

2.1.  Estimation-Theory  Approach  to  Imaging 

Progress  daring  this  reporting  period  has  been  made  on:  a,  extending  the  estimation-theo¬ 
ry  approach  to  include  a  specular  or  glint  component  in  the  radar-echo  data  in  addition  to  the 
diffuse  component  presently  in  the  model;  b,  analyzing  the  performance  of  the  estimation- theo¬ 
ry  approach  both  analytically  through  Cramer-Rao  bounds  and  with  simple  computer-simula¬ 
tions;  c,  extending  the  estimation-theory  aoproach  to  accommodate  constraints  on  the  received 
signal-to-noise  ratio;  d,  identifying  analytical  conditions  for  the  uniqueness  of  images  produced 
with  the  estimation-theory  approach;  and  e,  addressing  how  radar  signals  should  be  selected  to 
form  good  images.  Each  of  these  areas  is  described  briefly  below  and  more  completely  in  the 
appendices. 

2.1.1.  Inclusion  of  a  Specular  Component 

The  estimation-theory  approach  to  imaging  which  we  have  developed  to  date  is  based 
upon  targets  having  a  diffuse  reflectivity  with  no  specular  or  glint  component;  the  reflectivity  is 
modeled  as  a  zero-mean,  complex-valued  Gaussian  random  process  [6].  We  are  now  developing 
an  analogous  approach  for  targets  that  are  described  by  a  collection  of  purely  specular 
reflections  with  no  diffuse  component  The  model  we  are  using  and  a  status  report  for  this 
effort  are  contained  in  Appendix  I,  by  K.  Krause. 

2.1.2.  Performance  Evaluation 

The  estimation -theory  approach  to  imaging  yields  an  iterative  algorithm  for  producing 
target  images  [6].  As  a  result,  the  performance  of  the  resulting  images  is  difficult  to  predict 
analytically.  For  this  reason,  we  have  recently  developed  a  Cramer-Rao  louver  bound  on  the 
mean  sqnare-error  in  estimating  the  target’s  scattering  function.  This  is  discussed  in 
Appendices  2  and  3.  Another  approach  we  are  beginning  to  use  for  studying  the  performance 


and  for  making  comparisons  to  alternative  image  formation  strategies  is  computer  simulations. 
These  are  very  demanding  computationally.  Our  first  results  are,  therefore,  for  very  simple 
special  cases.  These  are  discussed  in  Appendix  2. 

2.13.  Forming  Images  Subject  to  a  Constraint  on  Input  Signal- to-Noise  Ratio 

We  have  extended  the  estimation-theory  approach  to  include  a  specified  input 
signal-to-noise  ratio.  The  result,  obtained  by  P.  Moulin,  is  discussed  in  Appendix  2. 

2.1,4.  Conditions  for  Uniqueness  of  Target  Images 

Conditions  for  the  uniqueness  of  target  images  formed  with  the  estimation-theory  method 
have  been  identified  by  J.  O’Sullivan  in  terms  of  the  Fisher  information-matrix  and  the 
Cramer- Rao  bound.  This  is  discussed  in  Appendix  3. 

2.13.  Signal  Selection  for  Target  Imaging 

An  effort  has  been  initiated  to  establish  a  method  for  determining  good  radar  signals  to 
transmit  for  delay-dcppler  imaging.  Preliminary  results,  obtained  by  J.  O’Sullivan,  are 
discussed  in  Appendix  3. 

23.  Chirp-Rate  Modulation  Approach  to  Imaging 

Work  is  continuing  on  the  chirp-rate  modulation  approach  to  imaging.  Using 
maximum-likelihood  estimation,  the  processing  to  be  used  cn  radar-echo  signals  has  been 
identified  when  a  linearity  constraint  is  placed  on  the  processing.  This  confidence-weighted 
processing  consists  of  a  bank  of  bandpass  matched  filters  followed  by  additional  filtering 
specified  by  solving  a  set  of  normal  equations.  These  equations  are  valid  for  a  variety  of 
modulation  formats,  and  we  are  presently  specializing  them  for  the  stepped-frequency 
waveform  so  that  we  may  compare  the  processing  to  conventional  two-dimensional  Fourier 
transform  processing. 
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4.  Appesdic es 

4.1.  Appendix  1.  Imaging  Specular  Targets 
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The  following  describes  progress  in  statistical  model  formulation  and  imaging 
approach  for  the  Maximum  Likelihood  Estimation  based  imaging  of  delay  and 
doppler  spread  specular  targets.  That  is,  targets  composed  of  multiple 
reflectors,  each  of  which  is  characterized  by  a  specular  reflection  process. 
According  to  Wehner  (ref.  1)  the  reflectors  on  such  targets  may  be  thought  of  as 
having  the  following  properties:  reasonably  constant  reflection  amplitude  with 
respect  to  small  aspect  change,  rapidly  varying  phase  with  respect  to  aspect, 
and  weak  (for  this  effort  negligible)  relationship  of  echoing  area  to  frequency. 

Target  Model  The  target  is  assumed  to  be  composed  of  an  array,  in  the  delay- 
doppler  plane,  of  specular  reflectors  as  described  above.  The  generic  return 
from  each  reflector,  with  attributes  sufficient  to  capture  the  aspects  of  Wehners 
properties,  is  postulated.  It  is 

Sr(g  SGra,  Bnm)  =  “V  Snm  -  *n)  COS  [  2x\fo  +  fm)t  ~2irfnTr;  +  b(t_tj»)  +  8anj] 
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where  t  is  the  continuous  time  variable,  xH  is  the  scatterer  delay  coordinate,  fE 
is  the  scatterer  doppler  coordinate,  Et  is  the  transmitted  signal  energy,  Bnm  is 
the  deterministic  amplitude  of  the  reflection  coefficient,  f0  is  the  radar  earner 
frequency,  f(t)  is  the  amphtnde  of  the  modulation's  complex  envelope,  o(t)  is  the 
phase  of  the  carrier  modulation’s  complex  envelope,  and  03m  is  the  random 
phase  of  the  reflection  coefficient.  Phase  8nm  is  assumed  to  arise  from  the 
following  probability  density  given  in  ref.  2: 


.  e*p[Amn  cos<enm)] 


2x  »o(Anm; 


-x  <  Bnm 


Asa  is  a  constant  which  can  be  adjusted  to  model  the  priori  knowledge  of  the 
randomness  of  the  phase  variations.  A  value  0  implies  a  uniform  distribution 
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or  nothing  known  about  the  phase  and  a  value  of  infinity  implies  the  phase  is 
known  exactly. 

Imaging  Approach  The  received  signal  available  from  which  to  form  images 
is  a  sum  of  returns  from  elements  like  those  described  above  located  at  an 
array  of  locations  {tn,fm)  in  the  deiay-doppler  plane.  This  signal  is  corrupted  by 
additive  white  gaussian  noise.  The  received  signal  may  thus  be  expressed  in 
terms  of  the  generic  returns  from  individual  scattering  elements  as: 


N-l  M 

Sr2DteS>B)  =  £  2  sr(t;9nni»Bnm)  +  w(t) 

n=0  m=-M 
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N  is  the  number  of  discrete  delay  coordinates  where  scatterers  exist  and  M  is 
the  number  of  discrete  doppler  coordinates  on  either  side  of  0  at  which 
scatterers  exist.  w(t)  is  die  additive  white  gaussian  noise. 

The  desired  image  is  the  maximum  likelihood  estimate  of  the  magnitude  of  Bnm 
at  each  point  in  the  target  array. 

Technique  1  By  making  some  assumptions  on  the  relation  between  T  and  the 
doppler  resolution  and  by  restricting  the  class  of  allowed  complex  envelopes 
somewhat,  a  likelihood  ratio  can  be  derived  which  has  the  form  of  a  product  ef 
ref.  2's  likelihood  ratios  for  the  detection  of  a  known  signal  with  an  unwanted 
phase.  Thus,  the  2D  imaging  problem  may  reduce  in  level  of  complexity  to  that 
of  estimating  the  reflection  magnitude  of  a  single  generic  target.  To  date,  the 
form  of  the  solution  for  case  Anm=0  and  Anm  approaching  infinity  have  been 
investigated.  A  reiativeiv  simole  expression  results  for  the  latter  case 
(corresponding  to  phase  known  exactly).  For  Anin=0  (phase  uniformly 
distributed),  an  expression  containing  modified  Bessel  functions  of  the  first  kind 
and  orders  0  and  1  results  which  woulo  have  to  be  iteratively  matched  with  a 
linear  function  of  their  arguments  to  converge  on  a  solution  The  case  for  Anm 
arbitrary  yields  even  more  complicated  expressions  which  would  have  to  be 
solved  using  computer  iterations. 

Technique  2  Currently,  the  EM-algorithm  of  ref.  3  is  being  Investigated  in 
quest  of  a  more  tractable  iterative  solution  to  the  problem.  The  first  and  most 
obvious  form  of  the  complete  data  space  model  looked  at  in  this  regard  appears 
to  have  a  degeneracy  which  practically  would  cause  the  accumulation  of  time 
samples  beyond  the  first  2  to  not  be  meaningfully  used  in  the  estimation 
procedure.  This  will  be  rechecked.  The  next  step,  currently  in  work,  is  to  look 
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for  a  new  complete  data  space  model  which  will  provide  meaningful  utilization 
of  all  data  with  improved  traciabiiity  over  Technique  1. 
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4.2.  Appendix  2.  Performance  Analysis,  Penning  Images  under  z  Power  Constraint 
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Performance  Analysis  for  Maximum  Likelihood  Spectrum 
Estimation  of  Periodic  Processes  from  Noisy  Data  * 


P.  isoz&t 
D.  L.  Snyder 
J.  A.  O’Svtttvsn 

Electronic  Systems  and  Signals  Research  Laboratory 
Department  of  Electrical  Engineering 
Washington  Universty 
Saint  Louis.  MO  63130 


1.  Introduction 

A  promising  approach  to  maximum-IikeEhood  estimation  of  ToepHts  constrained  covariance 
matrices  has  been  proposed  recently  jlj.  Several  developments  can  be  considered-  First,  tins  method 
sWi  anpfies  to  the  dual  tnoblem  of  spectrum  estimation.  Another  issue  (A  interest,  is  that  the  statistical 
model  can  account  for  the  presence  of  additive  noise  corrupting  the  observations  and  for  linear 
transformations  cf  the  process  •whose  covariance  or  spectrum  is  sought.  These  consd nations 
motivated  a  new  approach  to  high-resolution  delay-doppler  radar  imaging,  where  a  major  goal  is  to 
produce  estimates  of  the  target’s  scattering  function  ji2J.  hi  the  special  case  where  the  transmitted  sig¬ 
nal  s  i  constant  and  there  is  only  cue  delay  bin,  this  reduces  to  a  spectrum  estimation  problem  This 
paper  describes  some  recent  results  obtained  for  tins  sunpEned  problem. 

Our  model  is  presented  in  Section  2.  A  maxim um-SteEbood  formulataoa  cf  the  problem  is  given 
in  Section  3,  and  it  is  shown  bow  the  equations  can  bt  solved-  Section  4  is  the  main  section  The  sta¬ 
tistical  performance  of  the  estimator  is  studied,  and  it  is  shown  bow  it  compares  with  more  tradhsonal 
methods  such  as  the  periodogreaa.  The  results  are  encouraging,  and  future  directions  for  research  are 
pronosed.  Oae  snch  direction  consists  of  using  a  priori  information  on  the  signal  Wnea  this  imonna- 
rioa  is  in  the  form  of  a  constraint  on  the  signal  power,  a  new  estimator  can  be  derived  by  maximizing 
the  likelihood  subject  to  that  constraint.  Theoretical  issues  of  existence  and  uniqueness  of  the  solution 
are  discussed  in  the  last  sectrca. 

2.  Model 

We  now  present  two  models  feu-  the  spectrum  estimation  problem.  They  fundamentally  diner  in 
A??,  the  fust  one  accounts  for  noise  corrupting  the  observations. 

2-1-  Model  1 

This  follows  from  the  model  presented  in  %,  when  the  transmitted  signal  is  a  constant  and  only 
one  delay  bin  is  considered-  Let  r  be  an  N-vector  sample  of  a  real  Gaussian  process  corrupted  by  an 
additive  white  Gaussian  noise  : 

r  =  i  -f-  w  ,  (2-1) 

where 

tc  is  an  additive  white  noise  with  covariance  matrix  .Y0/v,  uncorrelated  with  b.  where  /%-  is  the 
NxN  identity  matrix: 

*  TZn  wcci  tj  cocM*  araber  N0003*-S54C-CE7D  froa  sit  OSes  <£  >&t*J  Rtsnrch. 
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b  is  made  of  samples  of  a  Gaussian  periodic  process  with  period  P  >  N. 

Both  b  2nd  a?  2re  zero-mean.  The  periodicity  assumption  guarantees  that  the  likelihood  function  is 
bounded  above,  therefore,  there  exists  a  maximum-likelihood  estimator  1,.  The  assumption  also 
implies  that  the  covariance  matrix  Kp  for  a  full  period  of  the  process  is  a  Hermitian  symmetric,  circir- 
lant,  ToepHts  matrix.  Its  eigenvectors  are  columns  of  the  PxP  DFT  matrix  \V?.  so 

Kp  =  W'aApHtp  ,  (2.2) 

where  superscript  f  denotes  the  Hermirian-transpose  operator  cm  matrices,  and  Ap  is  a  PxP  real  diag¬ 
onal  matrix  whose  diagonal  entries  are  sonnegativa  and  are  spectrum  samples 

Assume  now  that  we  are  only  interested  in  estimating  M  of  the  P  spectrum  samples  (1  <  M  < 
P),  the  other  spectrum  samples  being  zero.  This  assumption  is  introduced  to  deal  with  the  bandiimited 
spectra  encountered  in  radar  applications  *2].  We  define  Use  diagonal  matrix  of  spectral  parameters  IT 
bv 


Ap  —  , 


where 


i  0  0 
^0  0  /p/_iy5 

and  /( ir-Hi/2  and  fa-i)/*  are  respectively  the  (M-fl)/2  X  (M-rl)/2  and  the  (M-l)/2  X  (M-l)/2  identity 
matrices.  For  simpfirity,  we  consider  M  to  be  odd.  Only  the  first  (M-fl)/2  and  the  last  (M-l)/2  diago¬ 
nal  entries  of  Ap  are  nonzero,  and  these  define  the  diagonal  entries  (r(i)  of  the  MxM  diagonal  matrix 
D.  The  NxN  covariance  matrix  iQ  of  b  is  the  tipper  left  comer  of  Kp.  From  (2.2)  and  (2.3), 

Kt  =  I^EI- ,  (2.4) 


where  we  define  the  MxN  matrix  to  be 


T  =  MuWp\Is  flf 


The  covariance  matrix  for  r  is  then  given  by 


K.  =  F’ET  -i-  NqIx  - 


2J2.  Model  2 

in  most  spectrum  estimation  problems,  it  is  assumed  that  the  observations  are  samples  of  the 
process  of  interest.  This  is  also  the  model  assumed  in  (lj.  This  is  a  special  case  of  (2.1)  in  which 

r=b.  (2.7) 

From  the  definitions  in  (223)  and  (2^)  for  T  and  F.  the  covariance  matrix  for  r  is  now  given  by 

k.  =  rsr .  (2^) 

3.  Spectrum  Estimators 

In  our  amularions  in  the  next  section,  we  compare  the  performance  of  three  estimators  for  the 
spectrum  of  the  process  b  given  r  from  equation  (2.1).  These  three  estimators  are  presented  in  this  sec¬ 
tion.  There  are  two  maxi mnm-fikehbood  estimators  derived  from  models  1  and  2.  and  denoted  by 
MLl  and  MLO,  respectively.  The  third  estimator  is  the  periodogram. 

3-1-  MLl  Estimator 

This  estimator  is  derived  from  model  1.  Following  the  formulation  in  j2],  the  equation  for  the 
received  signal  can  be  rewritten  as 

t  =  He  -r  to  ,  (3.1) 
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where  c  is  a  zero-mean  Gaussian  random  vector  with  diagonal  covariance  E  The  likelihood  function 
for  Kr  is 

L{r,iC)  =  -fc  In  det  A,  -  S  r'iC*  r  .  (3.2) 

From  (2.6)  and  (3.2),  the  likelihood  function  for  E  is 

L(r,E)  =  -fcln  det  (TET  4-  N0IS)  -  *  rS(T2T  4-  N0Is)r  r  (3.3) 

Maximizing  the  likelihood  with  respect  to  E  yields  the  necessary  trace  condition  which  the  estimate  E 
must  satisfy  [1,2}: 

Tr  [r(ri:r  +  Noi^i^-P  et  -  N0i^rir  +  N0isp  rst]  =  o .  (3.-J) 

for  all  MxM  diagonal  matrices  SE.  This  trace  condition  is  a  nonlinear  equation  in  E.  Generally  h  can¬ 
not  be  solved  directly  in  cksed-form,  so  some  numerical  search  procedure  must  be  implemented  An 
elegant  solution  is  the  expectation-maximization  (EM)  algorithm  used  in  '1*]-  An  initial  estimate  ff* 
is  selected.  At  step  k-rl  (k  =  0,1,..)  the  estimate  is  updated  accordin'  to 

=  argmtn  Q(ZiE^)  (3.5) 


where 


<3(El  EW)  =  -S  jJ  In  <r(i\  -  S  £[  1  c(i)  j  2  (  r.£«j  /  c=(i)  . 


£1 1  c(ol2 1  r,Ewj  =  | f:(i)  -  ~  t^ixr^r-N^p 

rr‘(PimT~N0Is)^r^H]  [ii)  .  (3.7) 

This  algorithm  produces  a  sequence  of  estimates 

=  £)  lc(«1*  ir,E(t)]  (3.S) 

having  increasing  likelihood.  It  can  be  drawn  that  the  stable  points  of  this  algorithm  satisfy  the  neces¬ 
sary  trace  condition  for  a  maximizer  [2]  The  issue  of  uniqueness  is  addressed  in  a  comoanion  paper 
j3). 

Special  case  :  N  =  M  =  P  =  1 ,  N0  =  0 

A  cksed-form  expression  for  E  can  be  derived  in  this  special  case; 

£”(»)  =  ma^O.r2  —  .\'0) .  (3.9) 


3-2.  MLQ  Estimator 

When  model  2  bolds,  the  equation  for  the  received  sgnal  can  be  rewritten  as 

r  =  F'e  ,  (3.10) 

where  c  is  a  zero-mean  Gaussian  random  vector  with  diagonal  covariance  E  From  (IS)  and  (32),  thr 
likelihood  function  for  E  is 

L{r,E)  =  —Is  In  det  (TEF)  -  *s  r^r'ETT'r  .  (3.11) 

As  for  model  1,  a  trace  condition  for  a  maximizer  of  the  Hkelrhood  can  be  derived.  The  EM  algorithm 
can  also  be  usd  to  solve  this  nonlinear  equation  in  E.  The  sequence  of  estimates  is  still  given  by  (3  S), 
where  now 

E[ !  c(i)l*  i  ni^}  =  ffP  -  ff’ixr^rr*!’^  -r  Errtri?*rr-'’{rilBr)-'r±{*'  m 

Clearly  MLO  and  MLl  are  equivalent  for  noise-free  problems  {.Vn  =  0). 

Special  cose  :  N  =  M 
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The  problem  for  which  the  comber  of  observations  (N)  is  equal  to  the  number  of  parameters  to 
be  estimated  (M)  is  of  some  practical  interest.  It  also  toms  out  that  the  trace  condition  can  be  solved 
in  cksed-form  in  this  instance.  The  matrix  T  is  then  invertible.  Equation  (3.10)  indicates  that  there  is 
a  one-to-one  mapping  between  r  and  c,  and  the  MLO  estimator  is  simply 

»(0*l0^rXi1*.  (3.12) 

where  F-i  denotes  (F-2)5. 

3.3.  Periodogram 

The  periodogram  estimate  cf  the  P-specirum  of  the  periodic  process  is  amply  the  magnitude- 
squared  Fourier  transorm  o?  the  observations  kl, 

\r\ 

A?  =  [Pm  iJri  0l  \V?.  (3.13) 

Assume  we  are  looking  only  at  the  first  M  spectrum  samples.  Then,  from  (2.3),  (2.5)  and  (3.13),  E  is 
given  by 

?tf  =  (P/N)i(rr%&  (3.14) 

Special  cose  :  N  —  M  —  P 

When  N  =  M  =  P,  the  matrix  T  is  equal  to  WP  and  periodogram  and  \£LC  estimates  are  the 
same.  Is  this  case,  a  full  period  cf  the  process  is  estimated. 

4.  Performance  Analysis 

In  this  section,  we  apply  the  three  estimators  presented  above  to  model  1  and  study  their  statist¬ 
ical  performances.  The  bias  and  variance  are  evaluated  for  each  estimator,  where 

a«C^  =  £fE]-E  (4.1) 

and 

V'erftj  -  E> E*j  -  (£fEj?  .  (4.2) 

As  we  shall  see  in  Section  4.3.  the  performance  strongly  depends  upon  the  input  signal  to  noise  ratio 
denned  by 

5A7?«=£0/iVa,  (4.3) 

where  E*  is  the  average  power  of  the  process,  defined  by 

Eq  =  Kj(0)  =  (l/P)  Tr  [Ej  .  (4.4) 

From  (4.1)  and  (4J1),  we  derive  the  diagonal  mean-squared  error  (MSE)  matrix 

MSE  [E]  =  EgE-El2]  -  VcriE]  -f  (5i«iEif  .  (4.5) 

The  output  signal  to  noise  ratio  matrix  is  defined  as  follow- : 

SA7?«.[E]  =  E  { MSE  El)"*  (4-6) 

In  the  foSowing  section,  we  evaluate  the  bias  and  me.-n-squared  error  for  the  estimators  derived 
m  Section  3.  Whenever  clcsed-fo.m  expressions  for  the  ML  estimates  cannot  be  derived,  computer 
simulations  are  performed.  Typically  3000  realizations  are  generated  for  each  process  For  a  given  esti¬ 
mator,  (4.1)  and  (4.6)  are  then  estimated  from  the  3000  esrimates. 

4-1-  Performance  Analysis 

Closed  form  expressions  for  the  bias  and  mean-squa-  ed  error  are  derived  for  MLO  and  the 
periodogram  when  they  exist.  Simulations  were  cat  ried  out  o  compare  the  performance  of  the  esti¬ 
mators  for  various  levels  of  input  SNR.  The  performain.e  as  then  compared  to  the  Cramer-Rao 
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5«“R0]  =  ( (Pm  {rr*EiT')  —  e  Xt.0  +  (p/n)  n0  (rr*x^i) .  (4.14) 

The  bias  is  made  of  two  terms.  The  second  one  is  due  to  the  noise  and  is  proportional  to  .VG.  The  sen- 
amity  of  the  bias  to  the  noise  is  determined  by  the  diagonal  entries  of  the  matrix  IT*.  The  first  one 
is  independent  of  N0.  Even  for  noise-free  observations  the  period  ogram  is  a  biased  estimator  of  E 
unless  IT  is  the  identity  matrix.  This  would  be  'he  case  only  for  X  =  M  =  P  (observation  of  a  full 
period  of  the  process)  or  N/M  — *•  co. 

Mean-Squared  Error 


Taking  the  expectation  of  (4.12)  squared,  we  obtain 

SROf!  =  (F7A~)  i  -2  IS  Afi  I  (rrOfcdiT  4-  a  n0  S  Aj)  I  ot^  (ir^O 

J'O  i-o 


■  2M  (TT^i,if 


i r-i 


~  i  ^to)  (rnxi,  of  -r  prywpf  +  Av  £  f  l2  ]  - 

J- O 

Tins  expression  is  lower-bounded  by 

2 (. P/Nf  { (ITtEIT*  +  Aornxvl r  =  2 ( £J5-S(i)]  f  . 

From  (4-13)  and  (4.15),  (4-5)  becomes 


(4.15a) 


(4.15b) 


MSE  &2(i)]  =  (  ££2(0]  f  4-  { ( P/N)  (lTEfT  -  (N/P)  E  4  J\r0IT»X^O  f  ,  (4-l6a) 


and 


mse  f/(i)3  >  (i^/iv2)  ( ((rnEn^XbO2  4-  (iTErr  -  {n/p)  zyacf] 

-5-  2  n0  (ir^teO  (2  iTeiT  -  (jv/p)  sx«,0 

4-  2  ( N0  (rrxcof )  -  (4.16b) 


4.3.  Simulation  results 
Process  1 

Here  we  consider  a  lowpass  process  of  period  P  =  10.  There  are  M  =  5  nonzero  spectrum  sam¬ 
ples 

AO  - 1  * = 0>-->4 . 

The  number  of  observations  is  N  =  M  =  5,  and  the  noise  variance  .V0  ranges  from  0  to  1.  Figures  1 
and  2  give  a  plot  of  the  bias  and  SNR m  for  the  estimators  of  cr(2)  in  function  of  S.YrL.,  according  tc 
the  definitions  (4.1),  (4-3),  and  (4-6).  In  the  absence  of  additive  noise  (  SNR „  — ►  oo).  MLl  and  MLO  are 
the  same-  Both  are  unbiased  estimators.  The  period  ogram,  however,  is  biased,  and  its  MSE  is  also 
larger  than  the  MSE  for  the  ML  estimators.  When  A"0  increases  from  0.  *he  performance  of  the  esti¬ 
mators  is  roughly  constant  so  long  as  SNR^  remains  above  some  threshold  For  larger  .V0,  aL  three 
estimators  exhibit  a  strong  degradation  in  performance.  Comparing  the  thresholds  for  MLO  and  MLl 
we  see  the  tremendous  improvements  brought  by  taking  the  noise  into  account  in  the  model  Typi¬ 
cally,  for  a  same  SAT?,*.,  MLl  will  have  the  same  performance  as  MLO  operating  in  a  20  dB  noisier 
environment. 

We  also  notice  that  the  threshold  for  the  periodogram  is  located  ax  a  lower  SATh.  than  for  the 
ML  estimators.  In  Sections  422(h)  and  422(c),  we  indicated  how  the  sensitivity  of  the  performance  to 
the  net se  can  be  determined  for  MLO  and  the  periodogram  when  N  =  XL  It  turns  out  that  fc.  the  pro¬ 
cess  considered  here,  with  a  uniform  spectrum,  the  periodogram  has  a  lower  sensitivity  than  MLO  and 
MLl.  This  is  thought  to  be  due  to  the  smooth  spectrum  used  in  the  Emulation. 

Process  £ 


-  19  - 


It  has  been  conjectured  that  the  periodogram  does  not  perform  well  for  peaky  spectra  ol-  This 
motivated  our  study  of  a  sharply  peaked  spectra.  The  process  has  period  P  =  10,  and  is  made  of  a  sin¬ 
gle  spectrum  component 

^(0)  =  1- 

There  is  just  N  =  M  =  1  observation.  Bias  and  SNR„.  for  the  estimators  of  <r(0)  are  plotted  as  a 
function  of  SNR in  figures  3  and  4.  In  the  absence  of  additive  noise,  the  periodogram  is  very  strongly 
biased,  and  its  MSE  is  large.  Furthermore,  in  high-noise  environment  the  periodogram  b  no  longer 
more  robust  than  the  ML  estimators.  Clearly,  the  periodogram  b  outperformed.  It  should  also  be 
noticed  that  for  tins  process,  the  improvement  of  MLl  over  MLO  b  quite  reduced. 

Computational  Considerations 

The  convergence  rate  of  the  EM  algorithm  depends  on  several  parameters.  The  computation 
time  for  each  iteration  b  of  order  M  N2.  The  number  of  iterations  required  for  convergence  of  the 
algorithm  grows  as  M  and  N  increase.  For  MLl,  more  iterations  are  required  as  increases,  espe¬ 
cially  in  the  threshold  region  and  beyond.  Typical  figures  are:  for  process  1  with  N0  =  0.1,  30  itera¬ 
tions  are  required  before  the  spectrum  estimates  are  stable;  when  N0  =  1,  300  iterations  murt  be  per¬ 
formed.  Our  algorithm  b  implemented  on  a  Masscomp  model  5500.  Running  the  program  on  3000 
realizations  in  the  latter  case  b  typically  completed  in  6  CPU  hours. 


4.4.  Cramer-Rao  Bounds 


In  thb  section  we  study  how  the  performance  of  the  estimators  considered  so  far  relates  to  the 
Cramer-Rao  bound  on  the  variance  of  ant  unbiased  estimator.  The  Cramer-Rao  bound  on  the  van- 
ance  of  any  unbiased  (UB)  estimator  of  a  (f)  for  onr  model  has  been  found  to  be  [3] 

UB-CRtf[i)}  =  HO  -r  iW(v|  -  (4.17) 

From  (4.5)  and  (4.17),  the  MSE  for  an  unbiased  estimator  reaching  the  Cramer-Rao  bound  b  given  by 

JUSEpfa]  =  HO  +  Ayn^M)2 .  (4.18) 

The  Cramer-Rao  bound  on  the  variance  of  a  biased  (B)  estimator  of  <f  (0  is  given  by 

B-CRi*(i)}  =  UR-CRHO)  (  dEp{i)]/da({)  f  .  (4.19) 

From  (4.5),  (4.17)  and  (4.19),  the  MSE  for  a  biased  estimator  reaching  the  Cramer-Rao  bound  is  given 
by 

MSE^{i)]  =  HO  -T  iV0(ITt)-i(t,OF  (  dEp{i)}/df(i)  f 

+  {Bias\Sr(i)]f.  (4-20) 

From  the  analytical  expressions  given  for  £]£*(*)]  ™  Section  4.2,  we  can  now  calculate  the  gradient  of 

£|a~(0]  for  MLO  and  the  periodogram-  Then  the  minimum  MSE  for  a  biased  estimator  having  rhe 
same  bias  as  MLO  and  the  periodogram  b  derived,  and  a  comparison  with  the  actual  MSE  b  made  No 
dcsed-fonn  express  on  has  been  found  for  MLl. 

MLO 

From  (4.7), 

dElo(i)}/do{i)  =  1 .  (4.21) 


From  (4.S),  (4220)  and  (4221),  the  MSE  b  lower-bounded  by 
MSEjfW  =  c'(i)  4-  2  <r(i)  No  (ITVO'-O 


2 ;  Ar0  (rrrM  ? 


(4.22) 


Periodogram 

From  (4.13), 

dEp{i)}/do{i)  =  [P/N)  (ITTrX.;  0  -  (4-23) 
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Combining  (4.14),  (4.20)  and  (4.23),  the  MSE  ss  lower-bounded  by 

mse„  R«-)j  =  (p2/-*2)  ( {(rr*srnxM?  +  (rnzrr  -  (.v/p)  exm?; 

+  2  No  (itjXm1  (2  rr^Ern  -  {n/p)  ex*;o 

4-  2  ( 'V0  (rr*x^0F )  -  (^) 

Comparison  of  MSE 's  tcilh  Cramer-Rac  bounds 

The  Cramer-Rao  bounds  (4.22)  and  (4.24)  on  the  MSE  are  the  same  as  the  bounds  (4  1  lb)  and 
(4.16b)  derived  algebraically  from  the  exact  expressions  (4.11a)  and  (4.16a).  Figure  5  shows  how  the 
lower  bounds  compare  with  the  exact  expressions  for  process  1.  The  actual  MSE  s  are  3-4  dB  above 
their  respective  bounds. 

4.5.  Discussion 

The  results  derived  above  suggest  additional  comments  on  a  comparison  between  pericdorrara 
and  ML  estimators.  Typically  each  component  of  the  gradient  of  E[o~[i)]  given  in  (4.23)  is  »'  -h 
smaller  than  unity  for  the  processes  we  consider,  and  the  Cramer-Rao  bound  on  the  variance  of  U  e 
periodogram-like  biased  estimator  is  much  smaller  than  the  Cramer-Rao  bound  on  the  variance  of 
unbiased  estimators.  When  the  variance  dominates  the  MSE,  the  periodogram  offets  then  a  good  MSE 
performance.  This  was  the  case  for  process  1.  For  a  more  peaky  spectrum  such  as  the  one  chosen  for 
process  2,  the  bias  dominates  the  NEE  and  the  periodogram  is  outperformed  by  the  ML  estimators. 

5.  Constrained  maximum-likelihood  estimation 

5.1.  Description  of  the  problem 

An  examinauon  of  figures  1-4  suggests  that  MLl  suffers  in  certain  tarnations.  When  the  input 
S/vRc  is  low,  the  estimates  are  biased  and  their  variance  is  large.  Although  the  maximum-likelihood 
estimator  is  asymptotically  unbiased  and  efficient,  these  properties  are  not  guaranteed  in  small  sam¬ 
ples.  For  the  problems  considered  in  Section  4,  the  number  of  samples  is  only  equal  to  the  number  of 
parameters  to  estimate.  This  limitation  can  be  alleviated  if  a  priori  knowledge,  such  as  5A72,*,  is 
available.  Since  jV0  is  known,  such  a  constraint  on  the  agnal-to-noise  ratio  can  be  translated  into  a 
constraint  on  the  signal  power  tha  must  be  satisfied  by  the  maximum-likelihood  estimates.  In  the  fol¬ 
lowing  we  show  how  this  constraint  can  be  incorporated  into  the  EM  algorithm.  The  constrained  esti¬ 
mates  exist,  and  are  unique. 

5.2.  Equations 

The  equations  for  MLl  presented  in  Section  3.1  can  now  be  modified  as  follows.  At  each  step  of 
the  EM  algorithm,  we  maximize  Q{ E 1  E1*')  defined  in  (S.6),  subject  to  the  power  constraint 

ii~i 

£<P(i)  =  PEV  =  5  ,  (5.1) 

where  E0  is  the  constraint  on  the  signal  power.  The  solution  also  maximises 

AT— i 

Q(El  ET)  -f  X  ( £<r'i)  -  5) .  (5.2) 

j’«C 

where  X  is  a  Lagrange  multiplier.  Taking  the  gradient  of  (5.2)  with  respect  to  E,  we  obtain  a  quadratic 
equation  for  each  spectral  component 

2  X  -  <p(i)  -r  C;  =  0  ,  (5.3) 

where 

C;  =  E(lc(»-]i2lr,E(i)i 

is  calculated  according  to  (3.7).  The  solution  to  (5.3)  is 
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<r(i)  =  (1  +  iy  1-SCfX )  /  4X  :  X  =  o 


:  >  =  0  . 


where  4  is  either  —1  or  -I.  The  equation  for  X  is 


4SX  -  M=  V,  4-V l-SCA  .  (5.5) 

i=-D 

In  general  this  nonlinear  equation  in  X  cannot  be  solved  in  closed-form.  Furthermore,  an  ambiguity 
subsists  about  the  choice  of  the  sgns  4-  The  latter  problem  is  solved  bv  application  of  the  following 
theorem  : 

Theorem 

Assume  that  C70  >  Cit  i  =  Then 

(1) 

4-  =  -1  :  i  =  l,..,Af— 1 

/o  =  -fl  :  S  <  2C0  [M  -  E^4-Vl-(a/Co)  j 

=  —1  :  else 

(2)  X  is  the  largest  nonzero  solution  of 

( 4SX  —  M  +  Ha/g  f  =  1  -  8C0X,  for  and  (5.6a) 

lf-1 

X  =  0.  for  .*>  =  Q-  {5.6b} 

j-r 

X  is  upper-bounded  by  i/BC0,  and  the  equation  (5.6a)  can  be  solved  numerically  for  X.  Note  that  the 
particular  case  (5.6b)  is  also  the  solution  to  the  unconstrained  maximization  problem.  Next  is 

calculated  from  (5.4).  The  whole  procedure  is  repeated  at  each  maximization  step  of  the  EM  algo¬ 
rithm. 

5.3.  Discussion 

An  algorithm  has  been  derived  to  produce  maximum-likelihood  estimates  subject  to  the  power 
constraint  (5.1).  Currently  we  are  preparing  a  computer  implementation  of  this  algorithm,  and  the 
performances  of  the  constrained  estimator  win  be  studied.  As  indicated  in  Section  5.1,  noticeable 
improvements  in  high-noise  situations  are  expected. 

Conclusions 

In  this  paper,  we  have  described  our  approach  to  spectrum  estimation  from  noisy  data,  based 
nr  J®  a  statistical  model  for  the  observations.  From  this  model,  3  maximum-likelihood  estimator  is 
derived,  and  its  bias  and  MSE  are  computed  and  compared  with  two  methods  that  do  uct  take  the 
additive  noise  into  account.  The  new  estimator  can  perform  significantly  better  than  its  competitors. 

A  priori  knowledge  of  the  signal  power  can  be  introduced  as  a  constraint  to  improve  perfor 
mance.  Our  current  research  activities  include  evaluation  of  the  performance  of  the  new  estimator 
We  expect  significant  improvements  for  low  5.YR*.  Among  future  directions  for  research,  let  us  men¬ 
tion  another  issue  of  practical  interest.  The  information  about  SSR„.  might  have  the  form  of  in  ine¬ 
quality  rather  than  an  equality  constraint.  We  believe  that  the  method  described  in  Section  5  can 
easily  be  modified  to  incorporate  such  a  constraint. 
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Cramer  Rao  Bounds  for  Constrained  Spectrum  Estimation  ■with 
Application  to  a  Problem  in  Radar  Imaging 
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I.  Introductk* 

This  paper  excesses  scene  recent  theoretical  remits  which  we  have  derived  for  nsxsnsn  l&eEbood 
speany*!  carnation  problems.  Tee  pracrical  problem  whkh  has  morivared  modi  of  our  sariy  is  a  rieiay- 
cccgfer  iadar  imaging  problem  where  fee  spectrum  to  be  estunacd  corresponds  lo  an  image  of  ihe  target. 
Rsr  mis  praigsa  it  is  use  scss=rir.g  rimcrico.  which  is  z  delay  dependent  power  spectrum,  thst  is  of  intcrest. 
Fs  edged  psd&ns,  tbs  pscseter s  of  interest  are  the  lag  covariances.  These  problems  are  not  always 
equivalent  and  one  gci!  of  this  paper  is  tc  point  out  seme  of  the  isses  wish  are  unless  to  the  spectrum 
fomuite^rgv  Tr-»  ryrthrign 


The  resells  are  preseared  la  a  rsher  geaetd  sannee  and  are  then  specialized  to  problems  cf  interns.  First, 
problems  of  interest  are  dismissed.  This  section  aiso  introduces  some  of  the  notation  used  throughout  the 
remainder  of  die  paper.  The  dsd  section  derives  the  Crsner-eteo  lower  bmsd  for  the  variance  of 
unbiased  estimates  cf  the  spectrum  semper  Tins  bound  is  used  in  each  of  the  other  secdoos  of  the  paper. 
The  eqtsvaleace  of  aoanniqcesess  cf  maxssias  EkeEhcod  estimates  lor  the  specaam  samples  ssd  insure 
magnitude  of  the  Cmmer-Rso  lower  bound  is  then  desaasased-  Tbe  fourth  secaca  addresses  a  problem 
more  specific  to  the  radar  imaging  prebsem.  Tbe  tasi  is  to  choose  z  treesmised  sis-  ssds  that  the 
sgcctnsi  esdng&s  have  tasssasa  variance  This  is  accomplished  by  TTtfntmmng  tbe  Cramer-Rao  lower 
bound  web  resect  s>  tbe  aaasnn-ad  sgsaL  The  sad  section  discusses  the  imphcaaons  of  these  resells 
as  saggess  father  wesfc. 

2.  Problem  DeriaiSeo 

There  are  three  ptchiems  which  sre  of  interest.  Tbe  first  two  are  special  csss  ef  the  "S^bastss  of  the 
results  to  be  presented  are  appocafcle  to  only  one  of  tbe  special  cases. 

Let  Wf  be  a  Px?  DrT  maaix,  The  entry  of  WP  is  (1/^P  Je-*23**39 .  In  each  of  £s  dace  jsoblems,  r 
is  a  Stear  combtiaihs  cf  a  signal  vector  and  addavc  white  Gsnsstm  noise.  Tbe  goal  of  each  tscolem  is 
to  fed  the  maa-nsa  ggSbood  esrinree  ibr  the  power  spectrum  cf  the  desired  signal  oven  one 
observation  vector  r. 

Problem  ons; 

t  =b  +  (2.1) 

where  6  is  an  H-wecsr  sample  nurn  a  sere  mesa  Gaussian  process  with  Toeplitz  covariance  matrix  K<, 
agjy  g  wiae  Gaussian  poise  whit  covariance  -Vofy.  Tbe  matrix  S'j  is  aststaned  to  be  of  the  fonn 

Si  =  [/«  03  VfSW,  j  %] ,  02) 

l  J 
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where  2  is  a  PxP  real  tfiagral  maaix  with  ooanegaiive  entries,  In  is  an  NxN  identity  matrix,  and  t 
denotes  complex  armjngsta  transpose.  Tins  is  equivalent  to  assuming  thai  6  is  T/  times  c,  where  c  is  a 
zero  rr^m  vprtnr  with  covariance  2  sod 


l  =  *>  %  - 


Problem  two: 


r=Stb- t-w,  (2.4) 

where  v  is  as  before,  fe  is  an  M  ieagih  vector, 

6=[/«P/c,  05) 

bat  now  there  is  aa  NxM  matrix  Sf  multiplying  b.  The  vector  c  is  zero  mean  Ganssma  distributed  with 
real  diagonal  covariance  given  by  2  Under  these  assumptions,  the  covariance  of  r  is  S’;  -t-  AV.v ,  where 


*2=5^*  (QBV2W, 


lit  r  _ 
0  5~ 


=ri2Ti 


where 


r2=w?  s. 


Has  problem  reduces  to  the  first  when  N=MaadS  =/*-. 

Procian  three: 

r=Stb  4-w  08) 

where  w  is  as  before.  5f  is  aa  N  by  MI*  signal  matrix,  and  now  b  is  a  sample  hern  a  process  whose 
covariance  matrix  is  MlgxMIt  block;  diagonal  with  each  M  xJf  block  feeing  Toepliiz.  Separate  b  into  /* 
snbvecmrs  each  of  length  M  2nd  label  these  subvectors  sequentially  bom  0  to  Jg-1.  The  covariance  of 
h(i)  is  given  by 

K:  (t) = [/*  m£WWL  !  OS) 

where  K3  (fc)  is  me  k*  diagonal  block  of  the  covariance  of  b .  If  the  I  xL  matrix  Spi)  is  placed  in  the  i& 
diagonal  block  of  2  U?  yJJ;  block  diagonal  matrix,  2,  ibea  we  can  write 

*3= HIT*  (2.10) 

where  the  matrix  T;  is  defined  as  the  prodret  of  a  block  diagonal  matrix  and  S;  the  bled:  diagonal  matrix 
has  It  blocks  each  of  winch  equals  Wz,Un  0]*.  Far  this  problem,  let  F=£J*.  Has  problem  reduces  a  the 
second  when  mere  is  only  one  block  co  the  diagonal  (7*  =  1).  Sines  each  of  the  other  problems  is  obtained 
by  simplifying  this  problem,  we  can  foots  oar  snenti  on  cm  this  problem. 

We  follow  rite  analysis  in  [1,2].  Let  i  denote  either  1, 2,  or  3.  Problem  i  cay  be  restated  as  follows. 
Assttme  the  obscrvatica  ■sector  r  is  erven, 

r=r/c-w,  (2.11) 

where  c  is  a  Gaassiaa  random  variable  with  covariance  2,  and  w  is  white  Gaussian  noise  with  iatensrtv 
Nrfs-  Pita?  da  maxi  mam  IrreTihood  estimate  fe  2.  Under  the  assumptions,  r  is  a  Gaussian  distributed 
random  variable  with  covariance 


Kr  =rlil  t  +  *foTv- 
txmon  is  (neglecting  terms  caJ  involving  2) 

L(r&=-  4-  b  dstOilTi  -rtfefc)- \ t'CT/ST*  ~S^Ylr. 


(2-12) 


(2-13) 


Taking  tbs  psriai  derivative  with  respect  to  2  ami  setting  it  to  zero  yields  the  trace  condition  which  a 
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satisfy  [I^J,  *.  txso-isz*,'  conditi^a  ibf  2  to  be  the  maximum  likelihood  estimate  for  the 
spearnm  far  problem  k  isths*- 

TrUTtKT^Ti  *NJTHrri-^ XT*  -NJ'AT&Tt  ->  *o f^ItSg  =  0  (2-14) 

ibr2lHi2£C3sli2SncssSZo£tbes&2e>£z£25£.  TvpicaHy  this  eqrsrion  csnaoi  be  solved  for  £  explicitly 
and  same  iaosfre  sdssqae  or  oeesr^mirg  *Hr  saxrCirm  IfseShood  esfimste  most  be  used.  The 
algorithm  used  in  [1,2]  st  the  FM  slgLOfisn.  Qoc  xgqxgast  qaerna  which  fins  paper  addresses  is  tbe 
sniqaeaess  of  maxiaara  Skdibood  soicsZas.  A.-restfit  derived  is  tie  fourth  section  sates  tbax  a  sofarienx 
epedhioft  for  tbe  Rscsni^zcess  of  rrarhn-iTr.  SfcsChcxi  fasnates  is  fiat  tbe  Oramer-Rsc  lower  bcand  be 
infinire. 


S.  Cruaer-Jtao  Lower  Board. 

This  scctiha  cooCiis  z  d«  h*«fica  of  the  Cmmer-Sap  lora.tr  bound  for  unbiased  esrimzies  of  the  co  variance 
matrices  for  feepeboigms  figs  Section  2.  b  simpcsisit  55  rcmecaber  that,  fey  biased  erfimaies,  the  lower 
bound  for  tbe  variance  of  the  estimates  is  proportional  to  this  bound,  so  these  -.staibmcEas  are  relevant  for 
fiat  case  as  wdL  la  fact,  the  nacdmiHc  Ekd&acd  estimation  procedure  currcnfiy  Brr&nented  in  our 
bbcestory  generates  biased  estimates  for  the  spectrum  samples  under  certain  conditions 

FbBowwg  Vso  Trees  £3,  p.  7y}.  the  variance  cf  any  unbiased  maximum  livelihood  estimate  of  a 
aoran&xn  parasear  is  gre*uet  thar  or  equal  to  me  diagram  demerss  of  f^c  jgvrase  of  tbe  Fisher 
harema  tics  matrix.  Tbe  Fisher  informants  manix  has  entries  equal  U'  the  oegajvcs  cl  die  expected  value 
of  second  the  derivatives  of  L  (r  with  respect to the  paramerers  Qa  fins  case  2). 

Lemma  It  For  problem  k,  the  zj  dement  of  the  Pifivei  mfermaien  matrix  eqmCs  the  magnitude  squared 
of  mm  dement  of  tbe  masix 

r£(r|2Tt  +  VrJs'rri.  O-D 


Proof:  In  the  appendix  of  [1]  an  expression  for  the  second  derivarrre  of  L{r  J)  is  obtained-  Taking  the 
negative  of  the  expected  vake  yields  the  above  ejcpressianID 

The  above  resell  is  very  import am  for  the  smularicas  is  order  to  determine  the  peifocinsr.ee  of  the 
essnafioa  scheme  used.  Some  of  the  sinmisioas  performed  is  car  Labogasry  are  repented  in  [4]  and  the 
performance  is  compared  to  this  board.  In  addinon.  the  algorithm  proposed  in  [1]  is  compared  to  Oder 
algorithms  fer  estimating  spectrum  samples  and  it  is  shawm  that  is  certain  cases  this  algorithm  oatperfegms 
theaters. 

Oae  of  the  goals  of  calculating  the  Cramec-Rao  boced  is  to  use  it  so  CKomise  the  wd!  pcse&ess  of 
esrimarioa  problems. 

Lemma  2z  For  problem  one  the  rank  of  the  Fisher  informaka  matrix  is  less  than  or  equal  to  2N-1. 
Furthermore,  if  P  >2tf-l  then  there  Iz  no  raique  X  positive  definite  which  maximizes  the  tognkeShood. 

Proof:  Tbe  proof  involves  writing  the  riser  infoematka  matrix  z s  tbe  pnodc-ci  of  fiiree  matrices  one  of 
•which  is  2N-ix2N-L  The  rank  erf  this  matrix  is  fists  shown  to  be  less  than  or  equal  to  2N-1.  The  third 
matrix  is  the  Ssmirian  transpose  of  the  first  Tbe  first  matrix  is  P  by  2N-1  and  baskjn  dement  given  by 

j_  (322) 


where  k  denotes  the  row  sid  ranges  crotn  0  to  ?-l  and  m  ranges  seen  0  to  2N-2.  Let  tbe  dement  of 
(T/ITi  -5-7/c/^)-1  be  denoted  by  f  ^  Then  the  mps  demer.t  cf  the  second  matrix  is 


itV-jnV-2—)  aaPf-UV 


sr  fr^o-S  *ij.  -^S+'J  c3 . 


03) 


where  xn  and  n  range  from  0  to  2N-2  and  *  denotes  complex  conjogax.  Multiplying  these  three  matrices 
compbtts  the  first  joitcf  tbe  pnxf.  Fa-  tbe  second  part  of  the  proof,  a  is  easily  shown  that  tbe  addition  of 
a  real  dagonal  matrix  with  entries  all  of  the  same  magnitede -wifii  alternaring  ggns  to  any  matrix  does  not 
change  tbe  value  of  the  ktgSfcdihood  if  P>N-1.  Tans  no  positive  definite  Z  yields  z  unique  value  for  tbe 
loglireFnoocL  By  the  same  atgaarents,  no  S  with  cne  diagonal  entry  equ2l  to  0  and  the  rest  positive  yields 
a  unique  value  cf  L(r  J).  If  two  elements  are  zero,  however,  theammneat  fails  and  other  tests  must  be 
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lATirn*  2  gives  a  precise  statement  about  the  uniqueness  of  maximum  likelihood  estimates  for  the 
problems  <wiriii»rgriftn  in  particular,  il  precisely  die  number  erf  parameters  which  can  be 
ft«3TTnat«^  mnqnfjy  fnr  a  prnhtam  nf  type  me  We  believe  the  bouod  is  tight.  That  is,  for  a  problem  of  type 
one,  we  believe  that  a  utnqpe  marimnm  likelihood  estimate  exists  wneoever  F<2Ar— 1  and  that  the  Fisher 
iEfbunaboQ  matrix  is  of  rank  r  for  this  case.  The  bask  for  this  belief  is  that  the  hist  matrix  computed  in 
the  proof  has  fell  row  rank  far  P  <2N-L  For  cases  of  interest,  die  second  matrix  consstoed  is  erf  Ml  rank. 
If  this  second  matrix  is  of  full  rank,  the  inequality  in  die  hist  sentence  ci  the  lemma  statement  can  be 
changed  to  equality. 

The  proof  of  the  last  lemma  did  not  require  that  the  dements  of  theT  matrix  be  entries  Stan  Wy.  It  only 
required  a  certain  sanonarity  property. 

Lemma  3:  Let  the  h*n  efemem. of  Tt  beg,.,  and  suppose  that gf^giU  =  hijm-n  (the  product  depends  only 
cm  die  tow  number  and  the  difference  m-u).  Then  the  rank  of  the  Fisher  information  matrix  is  at  roost  2N-1 
and  if  P  >2N-i  there  is  no  mdqaeZposith’e  definite  winch  maxirizes  the  ktglikdibood. 

Proof:  Modify  the  proof  of  the  last  lemma  by  changing  the  first  matrix  to  have  km  dement  kijt-x+i.  The 
procrf  erf  die  first  part  is  then  identical  to  dial  proof.  To  show  that  there  is  no  unique  Z,  we  construct  a 
matrix  sach  that  if  dris  matrix  is  added  to  £  then  the  value  of  the  logfikdibood  does  doc  change.  This 
cSagocalpertmbaDooal  matrix  is  formed  as  follows.  Lett  denote  tb ei*  rowofli-  Then  we  have 

(3.4) 

Toe  potential  elements  of  this  matrix  are  completely  detsTnroed  by  the  elements  of  the  outer  products  of 
with  itself  for  ifromO  to  P-L  Form  P  row  vectors  with  the  elements  cf  these  ouier  products  by  taxing  the 
Krcneckcr  products  of  t  with  v*.  Tale  these  P  vectors,  transpose  them,  and  pal  diem  in  the  columns  of  a 
NhcP  matrix.  Denote  this  matrix  G~.  This  matrix  has  rank  at  most2N-l  over  the  complex  numbers  cue 
to  the  staticnarity  assumption  on  dements  of  Tt  stasd  in  the  Jemma.  The  2N-1  linearly  independent  rows 
haver-1  element  Ooc  of  these  linearly  independent  rows  has  all  real  elements  while  the  others  are 

in  general  complex  and  appear  in  complex  conjugate  parrs  (the  real  row  has  entries  /%£=  Ig,..  I2).  Thus 
this  matrix  has  ccamn  rank  almost  2N-1  when  taken  over  the  real  numbers.  Any  real  -vector  in  the  kernel 
of  this  matrix  may  be  placed  along  the  diagonal  of  a  matrix  and  then  added  to  Z  without  changing  the  '^hie 
of  L{rJ)  because  the  diagonal  matrices  fanned  in  this  way  bare  die  property  that  they  are  mapped  to  the 
zoo  matrix  when  premcitipSed  by  Tl  and  postmcltiglicd  by  Ft  £3 

Again  the  bound  is  tight  because  in  general  the  matrix  formed  erf  Knaecto  products  of  die  rows  of  I*  wifi 
have  rank  2N-1  over  the  reals.  Using  the  matrix  G  defined  in  the  proof  erf  Lemma  3  a  much  more  general 
result  may  be  obtained. 

Lemma  4:  Let  G  be  the  PxV2  matrix  whose  iA  row  is  the  Kronecker  product  of  t  wiib  -£*.  Assaeethat 
Kr  is  positive  dentate.  Then  die  Fisher  information  matrix  is  Angular  if  and  only  if  the  rank  of  G  is  less 
thanP.  If  a  positive  definite  Z  yields  a  unique  maximum  of  the  logliksHhood  function  then  G  has  rank  P. 

Proof:  The  fisher  infannadoa  matrix  may  be  written  as 

G{Rrl&Krl~)Gt.  (3  5) 

If  Kr  is  nopsingnlar  dan  the  rank  of  this  matrix  equals  the  rank  of  G  and  it  is  singular  if  and  only  if  the 
rank  of  G  is  less  than  P.  If  die  rank  of  G  is  less  than  P  then  pick  a  real  vector  j  such  thais7G  =  0  (such 
an  s  exists  because  the  Fisher  mfeem alien  matrix  has  real  entries).  If  these  vector  elements  are  placed 
along  die  diagonal  of  a  matri  x  sad  added  to  Z  die  matrix  Kr  remains  unchanged  and  das  die  loglikelihood 
is  unchanged.  On  the  other  hand,  if  the  rank  of  G  equals  P,  then  there  is  no  such  vector  x  and  any  change 
of  the  diagonal  entries  of  Z  yields  a  different  KT 13 

4.  Signal  Selection 

Tins  section  preseas  some  new  dunking  on  die  problem  of  signal  selection  for  radar  imaging  systems.  The 
approach  is  somewhat  geoetai  and  it  can  be  changed  to  fit  several  problems  cf  interest. 
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Most  approaches  to  radar  imaging  are  based  on  deterministic  terimk-sss.  Typically,  the  reSections  fox a 
the  target  are  assnmed  to  be  dKennimsdc  and  the  radar  reams  are  processed  using  a  two  dimensional 
transform  ecfcniqoe.  The  transform  used  (or  in  general  the  linear  processing  scheme  used)  may  be 
modified  for  the  problem  a  band,  bet  foe  overall  processing  scheme  is  fixed.  The  signal  selection  problem 
may  be  thought  of  in  a  couple  of  different  ways.  One  way  is  to  select  the  signal  which  optimizes  the  radar 
ream  for  the  processing  scheme  used.  For  example,  sapped  frequency  waveforms  described  in  [5]  may¬ 
be  thoaght  of  as  optimizing  foe  signal  aiming  that  two  tnmensicoal  Former  transforms  are  used  to 
process  foe  radar  ream.  In  other  words,  tins  transmmed  signal  attempts  to  reel oe  foe  ream  signals  loci 
Hire  fee  two  dimensional  Fourier  transform  of  tire  target  image.  A  second  type  of  signal  selection  is  more 
general.  In  this  case,  foe  signal  is  selected  E>  achieve  poise  compressioa  so  that  by  combining  tire  reamed 
signal  propriy  tbe  result  os  processing  achieves  desired  rsige  and  crossrange  resolution  [5]. 

Our  approach  for  radar  imaging  differs  from  conventional  approaches  by  stsring  from  a  model  which 
accurately  accounts  for  foe  true  naare  of  radar  reflections.  The  literature  on  the  physics  of  mfe 
leflecriotg  P,6]  s&tes  that  the  reflections  are  random  not  detcrrahnsric.  We  srart  with  a  model  which  tahes 
into  account  this  random  ness  (foe  tEscrere  version  of  this  model  is  given  by  problem  three  above).  Tbe 
processing  to  obtain  foe  *besf  image  ts  then  derived  [1].  This  processing  is  v2Ed  for  any  transmitted 
signal  as  keg  as  foe  model  is  vaEcL  Tims,  tins  processing  ctmld  be  used  on  foe  radar  reams  from  any 
sysrem  presently  implemented  if  tbe  target  falls  into  foe  category  covered  by  foe  model.  What  we  aim  to 
do  in  tins  section  of  foe  paper  is  to  introduce  a  procedse  for  selecting  foe  transmitted  signal  optimally. 
Tbe  signal  is  severed  to  maximize  a  measure  of  foe  achievable  performance.  The  potential  use  of  this 
procedure  in  practise  and  open  questions  winch  we  are  exploring  are  addressed  shortly. 

The  measure  wind]  is  used  to  determine  the  relative  merit  of  a  tmrnm-nn«rt  signal  is  foe  performance  which 
is  achievable.  The  penonnance  is  measured  in  terms  of  the  Fisher  infonnafoa  manhe. 

Definition:  Let  S  denote  the  set  of  admissible  sigra]  matrices.  Any  signal  matrix  SeS  defines  a  matrix  r3 
from  (2.10)  and  a  FxiV2  matrix  G  as  defined  sj  Lemma  4.  Let  Q  denore  tbe  set  of  possible  target  images 
fori.  Let{|-J>>  be  a  given  norm  on  PxP  matrices,  h  signal  matrix  SeS  is  said  to  be  optimal  if  5  achieves 

(41> 


A* 
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The  three  objects  winch  must  be  given  in  order  to  aacrap*  to  calculate  foe  optimal  5  areS,Q.andj]  -|p.  In 
order  to  amplify  the  derivation,  we  assume  that  tbe  set  of  posable  target  images,  C,  h2S  only  one  member, 
I.  This  resnichoa  will  be  discussed  hret.  For  foe  norm,  foe  trace  operator  is  chosen.  Since  all  of  foe 
matrices  trader  coeridsaiion  are  hexmitian  symmcgic  and  positive  semidefrnite.  the  trace  s  always  greater 
than  or  equal  to  zero  and  is  zurc  only  when  all  of  the  eigenvalues  are  zero  (and  hence  the  matrix  is  tbe  zero 
matrix  because  it  is  similar  to  a  zero  matrix).  Tbe  trace  is  additive  so  foe  triangle  inequality  holds  and  a 
state  times  a  matrix  scales  foe  trace.  Thus  for  foe  set  of  positive  semidefinite  hexmitian  symmetric 
matrices,  the  trace  is  a  valid  asm. 

There  are  several  pcsshiHiies  for  foe  set  of  signal  matrices.  For  both  inmimre  and  analytical  reasons  it  is 
important  to  have  a  constraint  on  foe  admissible  signal  matrices.  Inttrirively,  since  the  noise  intensity  does 
not  dewed  oq  foe  signal  magnitude,  one  would  expect  foal  increasing  foe  transmitted  energy  would 
decrease  tbe  effect  of  the  noise.  This  is  tbe  case  analytically  also.  Parameterize  foe  signal  matrix  as 
S=*®.  where  £.  may  be  thought  of  as  foe  transmitted  energy.  Obviously,  I3  may  then  be  written  as 
■v/^TV, where f3 is oteained from  T3 by  sribsrimringS  fbrS.  Similarly,  from  (2.10) and  (2.1 1) 

K3=E,filt3=E..Ky.  (42) 

and 

Kr=E,K3^N^  (43) 

From  I3  form  foe  matrix  G  foe  same  way  G  was  formed  from  I3.  Then  foe  nshsr  information  matrix 
(33)  may  be  rewritten  as 

EPGW£,K3 +NJKr*®(jE,K3-i-Nt!smGt  =  G  [(K3  *  ©tyE,)fo)-*  ®(ff3  -  }G^4.4) 

leering  Ej  gs  tege  decreases  foe  eigenvalues  of  K3  -r  increasing  the  eigenvalues  of  its  inverse. 
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Tins  Tr^Tg39K  fee  eigenvalues  of  the  Fisher  Mcrmadoo  matrix  and  bcace  increases  its  trace  (tbs  chosen 
norm)  Thus  if  the  signal  matrix  were  rmconsuained  in  size,  &e  eternal  signal  would  be  infinite. 

There  are  many  ways  to  constrain  the  allowed  magnitude  of  S.  Suppose  that  Jf:S-*R+  is  a  measure  of 
bow  large  SeS  is.  Then  we  may  isfnmslate  the  preckrn  as  msdmoe  the  norm  of  a»e  Fisher  mfbrmsaoa 
matrix  scfrject  to  the  constraint  that  M  (£)=£i.  For  example,  if  the  energy  is  a  qn3riraric  fsncrioacfS,  M 
say  be  seketed  to  be  the  trace  of  SfS.  At  this  point  die  measure  is  not  too  important  as  long  as  it 
constrains  the  largest  value  any  element  of  S  may  take.  This  is  no:  to  say  that  the  computational  results 
will  cot  depend  on  M ,  because  they  wH 

Using  say  standard  text  on  oprir.ilxation  theory  (fer  example,  see  [7]),  a  necessary  condition  for  lbs 
soltnioo  to  this  problem  is  that  there  exist  a  X  and  an  S  e  -S  scch  that 

-^f[G  gCr'1  ®  *)G  *3  +  =  0,  (45) 

ard 


Af(S)=£,.  (45) 

The  partis  derivative  Gf  the  trace  of  the  Fisher  information  matrix  with  respect  to  S  in  the  direction  SS  is 

rr^s^3sr/(ssn^vs+5wss)),  (4.7) 

where  V  is  fee  matrix  from  (25),  (2.10),  and  the  accompanying  discussion  such  dat  r3  =  VS.  After 
selecting  a  penicmnrAf .  ihe  previous  equations  are  solved  for  the  signal  matrix. 

This  approach  to  signal  selection  has  the  disadvantage  that  the  eqcakss  to  be  solved  21c  highly  nonlinear. 
Tt  shrarln  Tv.  nreierri  that  tb».  signal  msmr  >h»  partial  itmvarivn  mm  r^riU  hrvrh  tlin-rny  amt  ihrrngh 

the  matrix  Kf*.  Even  tlieagh  these  equations  may  be  difficult  to  solve,  in  practise  they  are  usually 
compmed  offline  and  thus  would  net  affect  me  realizability  of  ibe  proposed  system.  Any  constraints  cn  the 
signal  matrix  are  included  in  S  and  M  so  any  signal  competed  by  the  above  scheme  should  produce  an 
impknEsn2ble  signal  matrix. 

As  catriooed  previously,  the  choice  of  M  plays  a  large  pert  in  the  complexity  of  the  calculations.  A  good 
choice  of  xV  cocld  yield  2  calcolaticnfca- the  agn2lmaaix  in  dosed  form. 

Ice  results  derived  so  far  pertain  to  the  special  case  where  Q = TL  In  an  hnplemcniatkn,  the  actual  S  is 
enknovo.  One  possible  way  to  take  this  in©  account  is  a  transnit  multiple  pulses.  For  tbs  nrst  pulse, 
transmit  the  signal  which  would  be  ideal  for  sane  assumed  generic  target  (perhaps  a  inform  spectrum). 
Caltidye  an  image  using  tbealgorithm  in  [1].  For  pulse  ^transmit  die  pulse  wfckh  is  ideal  for  the  image 
which  is  the  output  of  the  k-1  imaging  serge.  The  convergence  of  rids  scheme  must  be  explored. 

5.  Conclusions 

This  paper  has  two  major  results  car  spectrum  estimation  problems  where  the  observed  data  is  the  sam  of 
white  noise  and  a  linear  cembinaioa  o?  artafizarkm  of  a  portion  of  a  periodic  process.  The  results  of  each 
part  are  derived  from  tbs  Cramer-Rao  lower  boend  for  fee  variance  of  spectrum  estimates.  The  first  set  of 
resits  (Seals  wish  uniqueness  of  maximum  likelihood  estimates  of  tie  spectrum  samples.  le  pankniar.  if 
the  Ksher  infixmsrioa  masts  is  singtiiar  then  there  is  r<c  positive  definite  spectrum  which  yields  a  umqne 
maximum  of  the  likelihood  junction.  The  second  set  of  results  proposes  a  new  method  for  selecting  radar 
signals  based  cn  die  Fisher  information  matrix.  Transmitted  signals  are  selected  to  maximize  the 
performance  achievable.  It  is  gtempgd  ©  mhanrizs  the  variance  of  the  estimates  of  the  sxetrura  samples. 
Thus  the  images  produced  may  be  reSed  upers  with  mors  confidence. 

We  are  still  m  the  process  of  implemeutmg  the  algorithm  proposed  in  [1]  ©  product  delay  duppier  images 
using,  maximum  nkdTrood  esrimaspe  isrisaqoes.  Same  preliminary  experiments  have  been  performed  on 
one  dimensional  versons  of  the  imaging  jaoblem  and  the  results  appear  promising  fCj.  When  going  ©  the 
foil  two  (StneasksBl  proccem,  the  issse-of  choosing  a  good  transmuted  signal  arises.  It  is  hoped  that  the 
method  proposed  here  will  yield  bene?  images  than  those  presently  used. 
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